Multimodal Interaction on a Social Robotic Platform
نویسندگان
چکیده
Zusammenfassung Dieser Beitrag beschreibt die multimodalen Interaktionsmöglichkeiten mit der Forschungsroboterplattform ELIAS. Zunächst wird ein Überblick über die Roboterplattform sowie die entwickelten Verarbeitungskomponenten gegeben, die Einteilung dieser Komponenten erfolgt nach dem Konzept von wahrnehmenden und agierenden Modalitäten. Anschließend wird das Zusammenspiel der Komponenten in einem multimodalen Spieleszenario näher betrachtet. Summary This paper presents the multimodal interaction capabilities of the robotic research platform ELIAS. An overview of the robotic platform as well as the developed processing components is presented, the classification of the components follows the concept of sensing and acting modalities. Finally, the interplay between those components within a multimodal gaming scenario is described.
منابع مشابه
Registering Multi-sensor Datasets from a Robotic Inspection Platform
In this paper we present a new method for the registration of multiple sensors applied to a mobile robotic inspection platform. Our main technical challenge is automating the integration process for various multimodal inputs, such as depth maps, and multi-spectral images. This task is approached through a unified framework based on a new registration criterion that can be employed for both 3D a...
متن کاملA Step towards Adaptive Multimodal Virtual Social Interaction Platform for Children with Autism
Recent advances in computer and robotic technology are enabling the application of such technology in assisting traditional intervention in developmental disorders such as autism spectrum disorders (ASD). A number of research studies indicate that many children with ASD prefer technology and this preference can be explored to develop systems that may alleviate several challenges of traditional ...
متن کاملOn a First Evaluation of ROMOT—A RObotic 3D MOvie Theatre—For Driving Safety Awareness
In this paper, we introduce ROMOT, a RObotic 3D-MOvie Theatre, and present a case study related to driving safety. ROMOT is built with a robotic motion platform, includes multimodal devices, and supports audience-film interaction. We show the versatility of the system by means of different types of system setups and generated content that includes a first-person movie and others involving the t...
متن کاملOn a Moving Base Robotic Manipulator Dynamics
There are many occasions where the base of a robotic manipulator is attached to a moving platform, such as on a moving ship, terrain or space shuttle. In this paper a dynamic model of a robotic manipulator mounted on a moving base is derived using both Newton-Euler and Lagrange-Euler methods. The presented models are simulated for a Mitsubishi PA10-6CE robotic manipulator characteristics mounte...
متن کاملMultimodal Resources for Human-Robot Communication Modelling
This paper reports on work related to the modelling of Human-Robot Communication on the basis of multimodal and multisensory human behaviour analysis. A primary focus in this framework of analysis is the definition of semantics of human actions in interaction, their capture and their representation in terms of behavioural patterns that, in turn, feed a multimodal human-robot communication syste...
متن کامل